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DETAILED ACTION 
Claim Rejections ■ 35 USC S 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

2. Claims 1-18, 21, 25 and 26 are rejected under 35 U.S.C. 102(b) as being 
anticipated by DeLorme et al (U S 5,848,373). 

Regarding claim 1, DeLorme discloses a context-aware imaging device, 
comprising: 

an image capturing (column 31, lines 1-2) and display system (column 23, lines 
51-53) that captures and displays an image containing a landmark of interest (column 
10, lines; column 13, lines 14-17 and column 23, lines 51-56); 

a context interpretation engine that generates contextual information relating to 
the landmark (column 24, lines 14-27), wherein the image capturing and display system 
and the context interpretation engine form a physically integrated unit (column 28, lines 
38-40). 

Regarding claim 2, DeLorme discloses the imaging device of claim 1 , wherein 
context interpretation engine generates the contextual information by determining 
geographical information of the landmark in the captured image (column 9, lines 19-29); 
searching a landmark database with the geographical information of the landmark to 
obtain the contextual information of the landmark (column 10, lines 10-24). 
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Regarding claim 3, DeLorme discloses the imaging device of claim 1 , wherein 
the context interpretation engine further comprises an area determination system that 
determines the geographical information of the landmark (column 10, lines 14-24); 

a landmark database that stores geographical information of landmarks and their 
corresponding contextual information to provide the contextual information of the 
landmark if accessed with the geographical information of the landmark (column 64, 
lines 3-6). 

Regarding claim 4, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises a location sensor that provides 
location information of the imaging device (column 55, lines 44-50); 

an orientation sensor that determines the direction in which the image capturing 
and display system is aiming (column 10, lines 10-24); 

a context interpreter that generates the geographical information of the landmark 
by defining a segmented viewing volume within which the landmark is located using the 
location (column 10, lines 4-24), the direction (column 12, lines 40-44), and the 
orientation information (column 10, lines 14-24). 

Regarding claim 5, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises a location sensor that provides 
location information of the imaging device (column 55, lines 44-50); 

an orientation sensor that determines the direction in which the image capturing 
and display system is aiming (column 10, lines 14-24); 
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a zoom sensor that determines the viewing angle of the image capturing and 
display system (column 54, lines 40-51 ); 

a context interpreter that generates the geographical information of the landmark 
by defining a segmented viewing volume within which the landmark is located using the 
location (column 10, lines 4-24), the viewing direction (column 23, lines 8-15), and the 
zoom information provided by the sensors (column 54, lines 40-51). 

Regarding claim 6, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises 

a location sensor that provides location information of the imaging device 
(column 55, lines 44-50); 

a distance sensor that determines the distance to the landmark from the image 
capturing and display system (column 55, lines 44-60); a context interpreter that 
generates the geographical information of the landmark from the location and distance 
information provided by the sensors (column 55, lines 44-60). 

Regarding claim 7, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises a location sensor that provides 
location information of the imaging device (column 55, lines 44-50); 

an orientation sensor that determines the direction in which the image capturing 
and display system is aiming (column 10, lines 14-24); 

a distance sensor that determines the distance from the image capturing and 
display system to the landmark (column 55, lines 40-60); 



Application/Control Number: 09/989,181 Page 5 

Art Unit: 2625 

a context interpreter that generates the geographical information of the landmark 
from the location (column 10, lines 4-24), the viewing direction (column 23, lines 8-15), 
and the distance information provided by the sensors (column 54, lines 40-51 ). 

Regarding claim 8, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises an image feature extractor that 
extracts searchable image features from the landmark in the captured image 9column 
45, lines 1-3); 

a context interpreter that uses the image features to search the landmark 
database for any landmark image with matching image features (column 43, lines 11- 
21). 

Regarding claim 9, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises a location sensor that provides 
location information of the imaging device (column 55, lines 44-50); 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image (column 45, lines 1-3); 

a context interpreter that uses the image features and the location information to 
search the landmark database for any landmark image with matching image features 
and similar location information (column 43, lines 11-21). 

Regarding claim 10, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises an orientation sensor that determines 
the direction in which the image capturing and display system is aiming (column 10, 
lines 14-24); 
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an image feature extractor that extracts searchable image features from the 
landmark in the captured image (column 45, lines 1-3); 

a context interpreter that uses the image features and the direction information to 
search the landmark database for any landmark image with matching image features 
and along the same direction (column 43, lines 11-21). 

Regarding claim 1 1 ,DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises a zoom sensor that determines the 
viewing scope of the image capturing and display system (column 54, lines 40-51); 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image (column 45, lines 1-3); 

a context interpreter that uses the image features and the viewing scope 
information to search the landmark database for any landmark image with matching 
image features and within the viewing scope specified by the zoom sensor (column 43, 
lines 1 1 -21 ;and column 64, lines 8-1 1 ). 

Regarding claim 12, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises a distance sensor that determines the 
distance from the image capturing and display system to the landmark (column 55, lines 
44-50); 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image (column 45, lines 1-3); 

a context interpreter that uses the image features and the distance information to 
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search the landmark database for any landmark image with matching image features 
and within the distance specified by the distance sensor (column 43, lines 11-21 and 
column 55, lines 44-50). 

Regarding claim 13, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises a zoom and distance sensor that 
determines the projection angle of the image capturing and display system, and the 
distance from the image capturing and display system to a geographical point at which 
the image capturing and display system is focused (column 57, lines 30-33); 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image (column 45, lines 1-3); 

a context interpreter that uses the image features (column 13, lines 14-27), the 
projection angle and the distance information to search the landmark database 
for any landmark image with matching image features and within the projection angle 
and distance specified by the zoom and distance sensor (column 49, lines 55-66). 

Regarding claim 14, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises a location sensor that provides 
location information of the imaging device (column 55, lines 40-50); 

an orientation sensor that determines the direction in which the image capturing 
and display system is aiming (column 10, lines 14-24); 

a zoom and distance sensor that determines the projection angle of the image 
capturing and display system, and the distance from the image capturing and display 
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system to a geographical point at which the image capturing and display system is 
focused (column 57, lines 30-33); 

an image feature extractor that extracts searchable image features from the 
landmark in the captured image (column 45, lines 1-3); 

a context interpreter that uses the image features, the projection angle and the 
distance information to search the landmark database for any landmark image with 
matching image features and within the projection angle and distance specified by the 
zoom and distance sensor (column 43, lines 11-21 and column 49, lines 55-66). 

Regarding claim 15, DeLorme discloses the imaging device of claim 3, wherein 
the area determination system further comprises a geographical information extractor 
coupled to the image capturing and display system to extract the geographical 
information of the landmark from the captured image (column 24, lines 14-24 and 
column 45, lines 1-5). 

Claim 16, is similarly analyzed as claim 1 above. 

Regarding claim 17, DeLorme discloses the imaging device of claim 1, wherein 
the context interpretation engine further comprises an updating module that can provide 
real time updates to the contextual and geographical information of each of the 
landmarks stored in the engine (column 24, lines 1-20). 

Regarding claim 18, DeLorme discloses the imaging device of claim 17, wherein 
the updating module further comprises a wireless communication interface that 
establishes wireless communication with external wireless network (column 63, lines 
42-45); 



Application/Control Number: 09/989,181 Page 9 

Art Unit: 2625 

an update request module that browsers external Internet via the wireless 
communication interface to obtain the real time updates (column 24, lines 1-20). 

Regarding claim 21 , DeLorme discloses the imaging device of claim 1 , wherein 
modules of the context interpretation engine reside in different enclosures, and have 
intermittent connectivity with each other(column 50, lines 59-67). 

Regarding claim 25, DeLorme discloses the imaging device of claim 1 , wherein 
the image capturing and display system can be selected from a group comprising a 
binoculars system, a telescope system, an eyeglass system, a camera system, a digital 
camera system, and a video camera system (column 59, lines 64-67). 

Regarding claim 26, DeLorme discloses the imaging device of claim 1 , wherein 
the context interpretation engine further comprises a user interface that allows user 
inputs to the context interpretation engine (column 49, lines 54-67); 
a storage that stores user inputs from the user interface, wherein the storage also 
stores the captured image of the landmark and its contextual information (column 22, 
lines 28-34). 

Claim Rejections - 35 USC $ 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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7. Claims 19, 20 and 22-24 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over by DeLorme et al (U S 5,848,373) in view of Mark et al (U S 
6,803,912 B1). 

Regarding claim 19, DeLorme is silent about the specific details regarding the 
imaging device of claim 1 , wherein the image capturing and display system and the 
context interpretation engine reside inside a single enclosure. 
In the same field of endeavor (displaying system), however, Mark discloses real time 
three-dimensional multiple display imaging system comprising the image capturing and 
display system and the context interpretation engine reside inside a single enclosure 
(column 18, lines 11-13). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to use the context interpretation engine reside inside a single 
enclosure as taught by Mark in the system of DeLorme because Mark provides 
DeLorme an improved system which it gives the three-dimensional lenticular work 
creator the ability to view artwork changes instantaneously on a three-dimensional 
screen with regard to a lenticular image he is constructing, instead of having to reprint 
an image array many times on an inkjet or laser printer to fit the kind of three- 
dimensional viewing he wishes to make. Also this system may be used to illuminate 
large lenticular arrays to create an autostereoscopic display. 

Regarding claim 20, DeLorme is silent about the specific details regarding the 
imaging device of claim 1 , wherein the image capturing and display system and the 
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context interpretation engine reside in different enclosures, but still physically attached 
to each other to form the physically integrated unit. 

In the same field of endeavor (displaying system), however, Mark discloses real time 
three-dimensional multiple display imaging system comprising the image capturing and 
display system and the context interpretation engine reside in different enclosures, but 
still physically attached to each other to form the physically integrated unit (column 18, 
lines 25-37). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to use the context interpretation engine reside inside a single 
enclosure as taught by Mark in the system of DeLorme because Mark provides 
DeLorme an improved system which it gives the three-dimensional lenticular work 
creator the ability to view artwork changes instantaneously on a three-dimensional 
screen with regard to a lenticular image he is constructing, instead of having to reprint 
an image array many times on an inkjet or laser printer to fit the kind of three- 
dimensional viewing he wishes to make. Also this system may be used to illuminate 
large lenticular arrays to create an autostereoscopic display. 

Regarding claim 22, DeLorme is silent about the specific details regarding the 
imaging device of claim 1 , further comprising a context rendering module coupled to the 
context interpretation engine to render the contextual information relating to the 
landmark to the user of the imaging device. 

In the same field of endeavor (displaying system), however, Mark discloses real time 
three-dimensional multiple display imaging system comprising a context rendering 
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module coupled to the context interpretation engine to render the contextual information 
relating to the landmark to the user of the imaging device (column 2, lines 54-55). 
It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to use the context interpretation engine reside inside a single 
enclosure as taught by Mark in the system of DeLorme because Mark provides 
DeLorme an improved system which it gives the three-dimensional lenticular work 
creator the ability to view artwork changes instantaneously on a three-dimensional 
screen with regard to a lenticular image he is constructing, instead of having to reprint 
an image array many times on an inkjet or laser printer to fit the kind of three- 
dimensional viewing he wishes to make. Also this system may be used to illuminate 
large lenticular arrays to create an autostereoscopic display. 

Regarding claim 23, DeLorme discloses the imaging device of claim 22, wherein 
the context rendering module is a display that can be either separated from or overlaid 
with a display of the image capturing and display system (column 23, lines 45-53). 

Regarding claim 24, DeLorme discloses the imaging device of claim 22, wherein 
the context rendering module is an audio player (column 59, lines 64-67). 

Other Prior Art 

9. The prior art made of record and not relied upon is considered pertinent 
to applicant's disclosure. 

Mitchell et al (U S 6,175,343 B1) disclose method and apparatus for operating 
the overlay of computer-generated effects onto a live image. 

Zediker et al (U S 5,781 ,229) disclose multi-viewer three-dimensional virtual 
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display system and operating method therefor. 

Baumrind et al (U S 6,621 ,491 B1 ) disclose systems and methods for intergrating 
3D diagnostic data. 
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